🕷️️ Job Radar • SCRAPING

upwork.com 🟢 2026-05-28

🔹 Multi-State Government Data Extraction & AWS API Deployment
👤 Client: 🇺🇸 United States Member since 2024-01-30
💰 Price: ****
🚩 Problem: Need for a scalable, automated pipeline to aggregate public data from diverse state government portals into a unified API for platform consumption.
📦 Existing: Existing platform with specific API conventions.

Specifications:

[Target] State government portals (North Carolina, Texas, Florida)
[Method] Pagination handling, dynamic content scraping, robots.txt compliance
[Stack] Python (Scrapy, BeautifulSoup, Selenium, Playwright)
[Stack] AWS EC2 (Isolated instance)
[Stack] FastAPI or Flask
[Format] Structured REST API endpoints, Database, or S3
[Security] Isolated AWS environment

Workflow:

1. Development of scrapers for NC, TX, and FL government portals.
2. Implementation of data cleaning, deduplication, and structuring logic.
3. Deployment of scrapers on isolated AWS EC2 instance.
4. Construction of REST API layer for platform integration.